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Abstract 

I We provide an estimate, sharp up to poly-logarithmic factors, of the asymptotic 

Qi^ ' almost sure mixing time of the graph created by long-range percolation on the cycle 

' of length A'^ (Z/NZ). While it is known that the asymptotic almost sure diameter 

. drops from linear to poly-logarithmic as the exponent s decreases below 2 [4j [10] , the 

asymptotic almost sure mixing time drops from A*'^ only to A'^''"^ (up to poly-logarithmic 
factors). 

(N 

> . 

^ ! 1 Introduction 

00 

m 

I In this note we study mixing time of simple random walks on the random graph obtained 

I by adding edges to a graph of a cycle, where edges are added between any two vertices with 

probability decaying with their distance, and independently for any two vertices (in fact, 



this probability is 1 — exp(— /3 \\x — y\\ where (3 and the exponent s are parameters). See 



^ ' below for definitions of the model and of mixing times, as well as further remarks. 

^ , The bounds on the mixing time are presented in the coming sections. 

•i-H . 

' Let us mention two interesting findings. First, the mixing time undergoes a phase transition 

5-H ' 

' as the exponent s decreases below 2. Second, in this natural model the almost sure diameter 

is a.a.s. (asymptotically almost surely) poly-logarithmic, for certain range of the parameters, 
yet the a.a.s. mixing time is polynomial. Such a gap between the diameter and the mixing 
time cannot exist for vertex transitive graphs or in graphs where the isoperimetric dimension 
is determined by the volume growth function. 
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The long range percolation graphs gained some recent interest, see |15] . From an algorithmic 
viewpoint it is useful to consider the mixing times of these graphs. 

1.1 The Model 

The model we discuss is the finite long-range percolation model with polynomial decay. Let 
TV be a positive integer, let /3 > 0, 1 < s < 2 , and consider the following random graph: Start 
with the cycle on N vertices (Z/A^Z). Define ||a; — y\\ = min{|a; — y| ,iV — |a; — y\}, (which is 
the regular graph-theoretical distance). The following edges are randomly added: li x ^ y, 
then X and y will be attached with probability 1 — exp(— /? ||a; — The different edges 

are all independent of each other. The probability of an edge between two (distant enough) 
vertices is very close to /3 ||a; — 2/11". We call the graph created this way GB^j3{N). 

For updated background on long-range percolation see p^Ol [TT| . 

1.2 Mixing Time 

Throughout this paper we consider random walks on a random graph. In order to avoid issues 
of convergence to the stationary distribution, we always consider the lazy random walk, i.e. 
the Markov chain on the vertices of the graph whose transition matrix is P{x, y) = 2dcg{x) 
(a:, y) is an edge in the graph, and P{x, x) = i. This insures that the random walk is ergodic 
and converges to the stationary distribution. 

Also, throughout this paper we consider oriented edges. Thus, if x and y are adjacent vertices 
of some graph, we consider both {x, y) and (y, x) as edges in the edge set. 

The variational distance of the random walk on a graph G is defined 

where P* is the t^^ power of the transition matrix of the walk, and tt is the stationary 
distribution, i.e. 7r(x) — '\e(g)\ (*i^§(^) degree of the vertex x, and recall that E(G) is 

the set of oriented edges) . (t) measures how close the distribution of the walk starting at 
X, at time t, is to the stationary distribution tt. 

Define 

r^(e) = min {t\yt'>t Ax{t') < e] . 
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Since we are interested in the time it takes the walk to converge to the stationary distribution, 
the mixing time is defined 

r(G) = max r,(l/4) 

xev{G) 

It is well know that using the second eigenvalue of the transition matrix, one can bound the 
mixing time of the graph. Formally (though not in full generality), Diaconis and Strook in 
[12] prove that: 

^^G) < MfflM, ,,1) 

I - AG 

where Xq is the second eigenvalue of G (i.e. the eigenvalues of the transition matrix of the 
random walk on G are 1 > \q > A3 > • • • > \\v(G)\- 1 ~ ^G is also called the spectral gap of 
G.) 



For more on mixing see [IJ I18j . 



1.3 Remarks 

• In the following sections we will provide upper and lower bounds on the mixing time of 
Gsj3{N), that match up to poly-logarithmic factors. It is interesting to note that using 
two different methods, we obtain matching bounds. 

• As will be seen in Section |4l a phase transition occurs in the mixing time when s passes 
from below 2 to above 2. Two open questions regarding the mixing time are: 

1. What is the mixing time at s = 2. We note that even the diameter is not known 
in this case. 

2. When s drops below 1, it is shown in 6J that the diameter is bounded. We 
conjecture that the mixing time is constant (independent of N) in this case. 

• Long-range percolation gives natural examples of graphs with small diameter (poly- 
logarithmic, see |10) ) yet large polynomial mixing time. Long range percolation is a 
natural model of some social networks, in which the probability you know a person 
decays with distance. This suggests that while the diameter of such networks might be 
small, sampling from such network via random walk might take long time. 

• For almost sure expansion of other models of random graphs see [31 [T7] . Regarding 
mixing for random walks on other models of random graphs see [7J I14j and [S] . 
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• Another question related to mixing on random graphs is the following: Let {G„} be 
a family of vertex transitive graphs such that lim„^oo |G„| = oo. Assume that the 
average degree of the giant component G'j of Bernoulli percolation on G„ is uniformly 
bounded in n. Prove 



• Consider uniform spanning tree on the long range percolation graph over Z. Our mixing 
time estimates show that the mixing time of long range percolation at s — 3/2 is like 
that of a 4 dimensional torus. Since the transition from tree to forest in the uniform 
spanning tree on Z"^ occurs at = 4, this suggests that perhaps the uniform spanning 
tree on the long range percolation graph over Z, is supported on a tree a.s. iff s > 3/2. 
See [S] for background. 

2 Upper Bound 

2.1 Multicommodity Flow 

Let P be the transition matrix of a reversible Markov chain, with stationary distribution tt. 
Let V be the set of states of the chain, and let E be the set of oriented edges; i.e. 



For x,y € V let V{x, y) be the set of all simple paths from x to y. Let V = Ux^yevVix, y). 
A flow is a function / : — > [0, 1] such that for all x,y £V 



t(G;) < O (max {t(G„) , \og^ |G„|}) . 



E = {[x,y) eV y.V : P{x,y)>Q}. 



The edge load of an edge e £ E is defined as 



/(e) 



p3e 



The congestion of a flow / is defined as 



p{f) = max 



1 



(a,b)£E n{a)P{a, b) 
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Theorem 5' of [H] states that if the eigenvalues of P are 1 > A > A3 > • • • > A„ (where 
n = \V\), then for any flow /, (1 — A)^^ < p{f)- Furthermore, Theorem 8 in ^18] shows that 
if P induces an ergodic Markov chain (i.e. if A„ > —1), then there exists a flow /* such that 
p{f*) ^ 16t, where r is the mixing time of the chain. We caU /* the optimal flow for P. 



2.2 Upper Bound 

We are now ready to prove an upper bound on the mixing time of Gs.p{N). 

Proposition 2.1. Let Gs,p{N) be the graph obtained by long-range percolation on the cycle 
of length N . Then there exists c — c(s, /?) > such that 

hm P [t{Gs,0{N)) < log"(iV) • N'-^] = 1. 

Proof. Set G = G.^/siN). With hindsight, set L = \N''-'^C{N)] for C{N) = a\og{N) / 2' (3 , 
and a > some constant to be determined below. Let £ ~ N (mod i), and set k ~ ^^y^- 
Divide the cycle into k intervals, Si, . . . ,Sk, so that ^i, . . . , Sk-i are of length L, and 5*^ is 
of length L + £ < 2L. Since s < 2, we can take N large enough so that 2'*/3L^ < N^. 

Let 1 < i j < k. Let £{i,j) be the event that there exist x G Si and y e Sj such that 
ix,y)eE{G). 

Let F be the graph obtained from G by contracting each of the intervals Si, . . . , Sk to a 
vertex. That is ^(F) = {1, 2, . . . , A:} and {i,j) G E{T) if £{i,j) occurs. 

We bound from below the probability that {i,j) G E{r). 

P[(*,j) ^£;(F)] =P[not = II nix,y)<^E{G)] 

< Yl cxp(-2'*/3iV-^) < e^p{-2'f3L'^N-'). 

xeSi 

y£Sj 

Using the inequality 1 — e~'^ > C/^ (valid for ( <E [0, 1]), we get that for all 1 < i ^ j < fc, 

¥[{i,j) G E{r)] > 1 - exp{-2'l3L^N-') 

2'P 
-~ ' 

Since fc > ^ — 1, we have that for large enough N (depending on s,f3), 

P[(^,j)ei?(F)]>£.i^, (2.1) 
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for all 1 < z 7^ j < fc. 

Let r' be the Erdos-Renyi random graph on k vertices, with edge probability P = ^ • 
That is, V{r') = {l,2,...,k} and e £'(r') and £ E{T') with probability aU 

edges independently. 

By (|2.ip . we can couple G and F' so that F' will be a subgraph of F. 

degp/(j) has the binomiaml distribution with parameters k,p. Thus, a quick calculation 
shows that there exists a constant ci — ci(a) > such that with probability tending to 1, 

max degr,(j) < cilogA^. (2.2) 

l<j<k 

Furthermore, in [S] it is shown that for large enough a, there exists a constant C2 > such 
that with probability tending to 1, 

r(F') < C2logfc < calogiV. (2.3) 

We now derive an upper bound on the mixing time of G, by constructing a flow on G, using 
the optimal flow for F'. 

Let TTcTTr' denote the stationary distribution of G, F' respectively. Let V{G),V(r') be the 
set of simple paths in G, F' respectively. Let V{x, y; G),V{i,j; F') be the set of simple paths 
in G,F' respectively, from x to y, i to j, respectively. For a path p let p+ be the starting 
vertex of p, and let be the ending vertex of p (specifically for edges e — (e+, e^)). 

For (i, j) g EiV) let e(i,j) be a specific edge such that e(i,j) = {x,y) G E{G) and x G Si 
and y G Sj (by definition there always exists at least one such edge). For 1 < j < fc let Gj 
be the induced subgraph on Sj. For x,y £ Sj let p{x,y) be a path in Gj that realizes the 
distance between x and y in Gj (a geodesic), li x — y let p(a:, x) be the empty path. 

For q G ■p(i, j;F'), and x ^ Vi,y ^ Vj, define p(q,x,y) G V{x,y]G) by interpolating q using 
the specified edges e(i, j) and geodesies p(a:, ?/); that is if q = 6162 • • • e|^| , then 

a;, y) = e+)e(e+, 6^)^(67, e+)e(e+, 62") • • ■ e(e|^|, e|;^|)p(e^|, y). 

Setting A = maxj diam(Gj) we get that \p{q, x,y)\ < (A + l)\q\. 

Let /* be the optimal flow on F'. As mentioned above, by Theorem 8 of [18^, using also 
(|2.3p . there exists a constant C3 > such that with probability tending to 1, 

W{i,j)eE{r') \E{r')\ ^ r(g)k| < 16r(F') < cglogiV. (2.4) 

ge-P(r') 
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We now define a flow / on G using /*. Let x,y € V{G), and let i,j be such that x G Si and 
y e Sj. 

li i = j set f(p) = 'KQ{x)'KQ{y) ii p = p(x, y) and otherwise. 
li i ^ j, then for any q G P{i,j; T') set 

f{p{q, X, y)) = J-'^^ ■ ■KG{x)TTG{y), 

and otherwise. 

We calculate the conestion of the flow /. Let (x, j/) G E{G), and let i,j be such that x G Si 
and y E Sj. 

Case 1: i j. In this case, any path p that contains the edge {x,y), such that f{p) > 0, 
must be of the form p = p{q, z, w) for some q G 7-'(r') that contains Thus, using (|2.2p 

and (1^ . 

<(A + l)-(max^G(5,))2-|i?(r')p- r(g)k| 
^ ge-P(r') 

^ ■ ^4 log'' • (A + 1) • (maxdegG(x))^ • L, (2.5) 

\E{G}\ 

where C4, C5 > are constants (independent of N). 

Case 2: i = j. I this case, any path p that contains the edge {x,y), such that f{p) > 0, is 
one of the foUwing: Either it is of the form p = p{q, z, w) for some q G V{r') that contains 
the vertex i, or it is of the form p =^ p{z,w) for some z,w E Si. Any path q G ViT') that 
contains the vertex i must contain some edge G E{r'). Thus, using (|2.2p and (|2.5p . 



z, w) 



P6-P(G) z,u;GS. j-(i.3)eE(T') q(^V(T') zeS^+ 

< X ^G(^)7rG(«^)A + degr,(i)-— ^•C4log"^iV-(A + l)-(maxdegG(x))2.L 

^ • ^6 log'' ^ • (A + 1) • (maxdegG(x))2 • L, (2.6) 

\E{G)\ 
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where cg, cy > are constants (independent of N). 

By our choice of L, and by (jl.ip . it sufRces to show that there exists constants cg, cg, cio, cn > 
(that may depend on s, (3) such that A < cg log*^^ N and max^^ AegQ{x) < ciq log^^^ iV, with 
probabihty tending to 1. 

In [3], the following is shown: There exist S — (5(s,/3) > and uq = no{s,f3) > such that 
for all n > no, 

P[diam(long-range percolation on the interval of length n) > log'^(n)] < 

Thus, since there are k < N/L such intervals, each of length at least L, a union bound gives 
that for large enough N, 

A = maxdiam(Gj) < log*(7V), (2.7) 

j 

with probability at least 1 — 0{N'^~^''), which tends to 1. 

Next, we show that with probability tending to 1, the maximal degree in G is bounded by 
21og(A^). This follows from the following considerations: 

Fix a vertex x in G. We can write degQ^x) = 2 + '^y^^ Z^^y, where Z^y is the indicator 
function of the event that x and y are connected by an edge not in the cycle. The random 
variables Z^y are all independent. Note that iixy = '^[Zxy] = 1 — e^'^H^^^H °, and for 
any t > 0, E [exp (tZxy)] = 1 + /ixy (e* — 1) < exp ((e* — l)fj,xy)- So we can calculate using 
Markov's inequality, for all A > 0, 

P [degG(x) > 2 + A] < exp (-A) [| exp ((e - 1) 

y^x 

< exp (-A + c(s, /3)iVi-^) . 

Thus, taking A = 21og(A'^) — 2 and using a union bound, the probability that there exists a 
vertex x with degQ{x) > 21og(A^) is bounded by N^^^^ < ^^-jp^- Thus, with probability 
tending to 1 we have that 

max degc.(x) < 21og(Ar). (2.8) 

xeV{G) 

Finally, combining Theorem 5' of il8j with the flow /, ([231), dM]), (HJ]) and (HH), and 

by our choice of L, we conclude that there exist constants c, c' > 0, (independent of TV, but 
perhaps depending on s,P), such that with probability tending to 1, 

r(G) < c\ogc'{N) ■ N'-K 

a 
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3 Lower Bound 



In Corollary 5.2 of [1], it is shown that t(G) > ft (A^'*"^) with probability tending to 1. This 
miraculously matches our upper bound up to poly-logarithmic factors. In [3] there is a typo 
in the parameters, so for completeness we provide the proof here. 

Proposition 3.1. Let Gs,p{N) be the graph obtained by long-range percolation on the cycle 
of length N. Then 

lim P \T{Gs.f3{N)) < cN"-^] = 0, 
where c = c{s,l3) is a constant independent of N. 

Proof. Let G = Gs.fsiN). It is well known (see e.g. [TKT^IIIH]) that it is enough to bound 
from above the Cheeger constant of the graph G, which is defined as 

\A\<N/2 

The natural subset to choose is A = {1,2, . . . , Af/2} (any arc of length N/2 will suffice). 
For X ^ A and y ^ A let Z^y be the indicator function of the event that x and y are 
connected by an edge not in the cycle. Then, Z^y are all independent. Set ^^y = ^[Zxy] = 
1 — exp (^—P \\x — 2/11"^ . For any t > 0, 

E [c-Kp{tZxy)] = 1 + /i:Ey(e* - 1) < exp{fixy{e'' - 1)). 
We have that \dA\ = 2 + J^xeA Sy^A ^^v 

f-xy < fJ-xy 
x£Ay^A xeAy^x 

< ^c(s,/3)7Vi-^ <c(s,/3)iV2-^ 

x£A 

Thus, there exists c = c(s, /3) such that for any t > and any A > 0, 

= exp {-tXN^-') n n ^ [exp(<Z.j;)] 

= exp (e* - 1) ^^2^ '^''P (-^A^^"') 

< exp{N^-' ■ {c{s,f3){e' -1) -tX)) . 
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Choosing t small enough, we get that for some fixed c = c(s, P) we have that 

lim P \\dA\ > cN^-'] = 0, 

which implies that with probability tending to 1 as tends to infinity, C{G) < cA^^"" for 
some (possibly different) c — c(s, /3) independent of N. 

This gives a bound on the mixing time (see |18|): 

with probability tending to 1, and c — c(s, (3) independent of N. □ 



4 A Phase Transition 

In the previous sections we have shown that the mixing time of Gs,0 is N'^^^ (disregarding 
poly-logarithmic factors) for 1 < s < 2. When s tends to 2, this quantity tends to N. We 
will show that a phase transition occurs at s = 2, meaning that for s > 2 the mixing time 
will "jump" to N^. 

Proposition 4.1. Let G = Gg.fiiN) for s > 2. Then the mixing time of G satisfies 

lim P \t(G) > cN^] = 1 
for some constant c = c(s, /3), independent of N. 

Proof. For simplicity we assume that N is divisible by 8. For other N the proof is similar. 
Also, for i = 1,2,. ..,8 set isTi {(i - l)f + I,..., if}. 

By the proof of Theorem 3.1 (A) in [4], there exists ci — ci(s, f3) such that with probability 
1 — o(l), we have that all sets Ki, . . . , Kg, each contain at least CiA^ vertices of degree 2. 

Further, by rotating the cycle, without loss of generality we can assume that tt{A) > tt{BUC), 
and that 7r(B) > 7r(C). This implies that t:{A U B) > |. 



Fix a vertex x ^ AUB, and let {St ; t > 0) be a simple random walk on G starting at Sq — x. 
Let T be the hitting time of the set AU B. Note that at any time t > t{G), we have that 

l-V[SteAUB]< ^ \n{y)-P'ix,y)\<2A,{t) <^ 



yeAuB 



e 
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So we conclude that for any x ^ AU B and t > t{G) we have that 

f[T<t]>V[St&A\JB]> 0.01. 

X X 

This impUes that for any x ^ A U B and for any real s, [T > s] < 0.99^^/^^^). Thus, there 
exists C2 > independent of N , such that 

oo 

E [r] = V P [T > < C2T. 
t=Q 

Set u = ^N. Recall that there are at least ciN vertices of degree 2 separating u from AU B 
(on each side of u). We will show that this implies that E„ [T] > c^N"^ for some C3 = 03(5, /3) 
independent of N. 

We use the language of electrical networks, see [131 [TB] for background. We remark that for 
the reader not familiar with these notions, one can use the Varopoulos-Carne bounds (see 
e.g. [in]) to show that a linear diameter implies that the mixing time is at least j^^^y- 

We can write T — X^x^Aus ^ where Vx is the number of visits to the vertex x, up to time 
T. Ground the set AU B (so that its voltage is 0), and set a potential to u so that there is a 
unit current flowing into u. We get that for any x, we have the identity E„ [V^] — v{x)d{x), 
where v{x) is the voltage at x, and d{x) is the degree of x (this follows from noting that 
Eu [Vx] /d{x) is harmonic). 

Let xi, X2, ■ ■ ■ , Xc-iN be the vertices of degree 2 on the side of u with at least 1/2 the current 
(without loss of generality say in the interval {^N + 1, . . . , iV}). Fix I < i < ciN. Since Xi 
is a cut point, the current flowing into and out of Xi is at least 1/2. Thus, the voltage at Xi, 
v{xi), is at least 1/2 the resistance between Xi and AU B. This resistance is bounded from 
below by the number of cut edges (which are resistors of resistance 1 connected serially), 
which in turn is bounded by the number of vertices of degree 2 between Xi and the set AUB. 
That is, v{xt) > i/2. Thus, 

E [T] > y E [Vx] - y dix)v{x) >yi = csN^ 

x<^A\jB x^A\jB 4=1 

d(x)=2 d(x)=2 

for some C3 = 03(5, /3) independent of N . 

We have shown that with probability 1 — o(l) there are a linear number of vertices of degree 
2 separating a vertex u from a set of high weight under the stationary distribution. Thus, 
t(G) > C4 E„ [T] > C5A^^, where C4, C5 depend only on s and /?. □ 

Acknowledgement. We wish to thank Ori Gurel-Gurevich for useful conversations. 
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